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Abstract 

Boman and Hendrickson [BHOl] observed that one can solve linear systems in Laplacian 
matrices in time O (m3/2+°(i) ln(l/e)) by precondit ioning with the Laplacian of a low-stretch 
spanning tree. By examining the distribution of eigenvalues of the preconditioned linear 
system, we prove that the preconditioned conjugate gradient will actually solve the linear 
system in time O (m^/^ ln(l/e)). 

1 Introduction 

For background on the support-theory approach to solving symmetric, diagonally dominant 
systems of linear equations, we refer the reader to one of [BGH+Oel [BH031 ISTO S] . 

Given a weighted, undirected graph G = {V,E,w), we recall that the Laplacian of G may 
be dehned by 

where is the Laplacian of the weight-1 edge from u to v. This is, is the matrix that 

is zero everywhere, except for the submatrix in rows and columns {u, v} which has form: 




Note that this last matrix may be written as the outer product of the vector tpu — i^v with itself, 
where we let ipu denote the elementary unit vector with a 1 in its u-th component. 

For a connected graph G, we recall that a spanning tree of G is a connected graph T = 
{V, F, w) where F is a subset of E having exactly n — 1 edges. As we intend for the edges that 
appear in T to have the same weight as they do in G, we use the same weight function w. As 
T is a tree, every pair of vertices of V is connected by a unique path in T. 

*This material is based upon work supported by the National Science Foundation under Grant CCF-0634957. 
Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) 
and do not necessarily reflect the views of the National Science Foundation. 



For any edge e £ E, we now define the stretch of e witli respect to T. Let ei, . . . , e/c S -F be 
the edges on the unique path in T connecting the endpoints of e. The stretch of e with respect 
to T is given by 

stT(e) = w{e) I^Y^ l/w{ei)^ . 

The stretch of the graph G with respect to T was defined by Alon, Karp, Peleg, and West |AKPW95] 
to be 

stTlG) = ^str(e). 

A low-stretch spanning tree of G is a graph for which the above quantity is reasonably small. The 
best known bound on attainable stretch was obtained by Abraham, Bartal and Neiman |ABN08] . 
who present an algorithm that, on input a graph with n vertices and m edges, runs in time O (m) 
and produces a spanning tree T of stretch 0(m log n log log n(log log log n)'^). 

The advantage of using a spanning tree as a preconditioner is that (after a permutation) one 
can compute an LU-factorization of the Laplacian of a tree in time 0(n), and that one can use 
this LU-factorization to solve linear systems in the Laplacian of the tree in linear time as well. 



2 Preconditioning 

We prove the following three results. 

Theorem 2.1. Let G = (V,E,w) be a connected graph and let T = (y,F,w) be a spanning tree 
of G. Let Lg and Lt be the Laplacian matrices of G and T , respectively. Then, 

Ti[LgLt^) =stT{G), 

where Lt^ denotes the pseudo-inverse o/Ly. 

As T is a subgraph of G, all the nonzero eigenvalues of Tr (^LgLt^^ are at least 1. The 
analysis of Boman and Hendrickson [BHOlj followed from the fact that the largest eigenvalue of 
LqLt^ is at most stj'(G). We use the bound on the trace to show that not too many of these 
eigenvalues are large. 

Corollary 2.2. For every t > 0, the number of eigenvalues of LgLj^^ greater than t is at most 

StT{G)/t. 

Theorem 2.3. If one uses the preconditioned conjugate gradient (PCG) to solve a linear equa- 
tion in Lq while using Lt as a preconditioner, it will find a solution of accuracy e in at most 
O (str(G)i/Mn(l/e)) iterations. 

As the dominant cost of each iteration of PCG is the time required to multiply a vector by 
Lg, which is 0{m), and the time required to solve a system of equations in Lt, which is 0{n), 
the low-stretch spanning trees of Abraham, Bartal and Neiman enable PCG to run in time 

The following lemma is the key to the proof of Theorem 12. li 
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Lemma 2.4. Let T = (F, F, w) he a tree, let u,v G V, and let x = ipu — tpv Then, 

k 



T 

X 



Lt^x = ^ l/w{ei), 



i=l 

where ei, are the edges on the unique simple path in T from u to v. 

Proof. The quantity x'^Lt^x is known to equal the effective resistance in the electrical network 
corresponding to T in which the resistance of every edge is the reciprocal of its weight (see, 
for example, [SS08] ). As only edges on the path from u to f can contribute to the effective 
resistance in T from u to v, the effective resistance is the same as the effective resistance of the 
path in T from u to v. As the effective resistance of resistors in serial is just the sum of their 
resistances, the lemma follows. □ 

Proof of Theorem \2.1[ We compute 

Tr (^LgLt'^^ = ^ w{u, v)Tr 

{u,v)<^E 



^ w{u,v)TT\^{'ll)u-i'v){'4'u-AVLT'' 

{u,v)eE 

w{u,v)Tt ({iIJu - 1pv)'^LT^i'4'u - i'v) 



(u,v)£E 

k 

w{u,v)^ l/w{ei) 



E 



(where ei, . . . , are the edges on the simple path in T from u to v) 

= ^ StT{u,v) 

{u,v)eE 

= StT(G). 



□ 



Proof of Corollary \2.SX As both Lq and Lt are positive semi-definite, all the eigenvalues of 
LqLt^ are real and non-negative. The corollary follows immediately. □ 

To show that the PCG will quickly solve linear systems in Lq with Lt as a preconditioner, 
we use the analysis of Axelsson and Lindskog |AL86l (2.4)], which we summarize as Theorem l2.51 

Theorem 2.5. Let A and C he positive semi-definite matrices with the same nullspace such 
that all hut q of the eigenvalues of AC^ lie in the interval [l,u], and the remaining q are larger 
than u. If h is in the span of A and one uses the Preconditioned Conjugate Cradient with C as 
a preconditioner to solve the linear system Ax = b, then after 



k = q + 



'ln(2/e) 
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iterations, the algorithm will produce a solution x satisfying 



< e 



def 



We recall that ||x||^ =' V x'^ Ax. While Axelsson and Lindskog do not explicitly deal with 
the case in which A and C are positive-semidefinite with the same nullspace, the extension of 
their analysis to this case is immediate if one applies the pseudo-inverse of C whenever they 
refer to the inverse. 



Proof of Theorem As G and T are connected, both Lq and Lx have the same nullspace: 
the span of the all-Is vector. 

Set u = (stTlG))^/^ and / = 1. Corollary [221 tells us that LgLt^ has at most q = {striG))'^^^ 
eigenvalues greater than u. The theorem now follows from Theorem 12. 5[ □ 
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